A Covariance Regression Model
نویسندگان
چکیده
Classical regression analysis relates the expectation of a response variable to a linear combination of explanatory variables. In this article, we propose a covariance regression model that parameterizes the covariance matrix of a multivariate response vector as a parsimonious quadratic function of explanatory variables. The approach can be seen as analogous to the mean regression model, and has a representation as a type of random effects model. Parameter estimation for covariance regression is straightforward using either an EM algorithm or a Gibbs sampling scheme. The proposed methodology provides a simple but flexible representation of heteroscedasticity across the levels of an explanatory variable, and can give better-calibrated prediction regions when compared to a homoscedastic model. Departments of Statistics and Biostatistics, University of Washington, Seattle, WA 98195-4322. Web: www. stat.washington.edu/~hoff. This work was partially supported by NSF grant SES-0631531. Some key words: heteroscedasticity, Markov chain Monte Carlo, multivariate, positive definite cone, random effects.
منابع مشابه
The Covariance Innation Criterion for Adaptive Model Selection
We propose a new criterion for model selection in prediction problems. The covariance innation criterion adjusts the training error by the average covariance of the predictions and responses, when the prediction rule is applied to permuted versions of the dataset. This criterion can be applied to general prediction problems (for example regression or classiication), and to general prediction ru...
متن کاملCovariance Estimation: The GLM and Regularization Perspectives
Finding an unconstrained and statistically interpretable reparameterization of a covariance matrix is still an open problem in statistics. Its solution is of central importance in covariance estimation, particularly in the recent high-dimensional data environment where enforcing the positive-definiteness constraint could be computationally expensive. We provide a survey of the progress made in ...
متن کاملEfficient semiparametric regression for longitudinal data with nonparametric covariance estimation
For longitudinal data, when the within-subject covariance is misspecified, the semiparametric regression estimator may be inefficient. We propose a method that combines the efficient semiparametric estimator with nonparametric covariance estimation, and is robust against misspecification of covariance models. We show that kernel covariance estimation provides uniformly consistent estimators for...
متن کاملRandom regression models for estimation of covariance functions of growth in Iranian Kurdi sheep
Body weight (BW) records (n=11,659) of 4961 Kurdi sheep from 215 sires and 2085 dams were used to estimate the additive genetic, direct and maternal permanent environmental effects on growth from 1 to 300 days of age. The data were collected from 1993 to 2015 at a breeding station in North Khorasan province; Iran. Genetic parameters for growth traits were estimated using random regression test-...
متن کاملCovariance-regularized regression and classification for high-dimensional problems.
In recent years, many methods have been developed for regression in high-dimensional settings. We propose covariance-regularized regression, a family of methods that use a shrunken estimate of the inverse covariance matrix of the features in order to achieve superior prediction. An estimate of the inverse covariance matrix is obtained by maximizing its log likelihood, under a multivariate norma...
متن کامل